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Abstract We consider homogeneous random walks in the quarter-plane. The 
necessary conditions which characterize random walks of which the invariant 
measure is a sum of geometric terms are provided in m\- Based on these 
results, we first develop an algorithm to check whether the invariant measure of 
a given random walk is a sum of geometric terms. We also provide the explicit 
form of the invariant measure if it is a sum of geometric terms. Secondly, 
for random walks of which the invariant measure is not a sum of geometric 
terms, we provide an approximation scheme to obtain error bounds for the 
performance measures. Finally, some numerical examples are provided. 
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1 Introduction 

Random walks in the quarter-plane serve as the underlying models for many 
two-node queueing systems. It is of great interest to find performance mea¬ 
sures, either exactly or approximately, of such systems. 

If the invariant measure of the random walk is known in closed-form, then 
the performance measures can be computed directly. The canonical example 
is the Jackson network of which the invariant measure is of product-form |12l 
Ghapter 6]. For some random walks the invariant measure can also be ex¬ 
pressed as a linear combination of countably many geometric terms |T]. How¬ 
ever, if the invariant measure is not of closed-form, then closed-form perfor¬ 
mance measures are often not available. Various approaches to finding the 
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invariant measure of a random walk in the quarter-plane exist. Most notably, 
methods from complex analysis have been used to obtain the generating func¬ 
tion of the invariant measure |il[5] . Matrix-geometric methods provide an al¬ 
gorithmic approach to finding the invariant measure [5]. However, explicit 
closed-form expressions for the invariant measures of random walks are diffi¬ 
cult to obtain using the methods mentioned above. Hence, it is, in general, not 
possible to find exact results for the performance measures of random walks 
in the quarter-plane. 

Our first contribution in this paper is to characterize the class of random 
walks for which the invariant measures can be expressed in closed-form. In 
particular, based on results from n we characterize the random walks for 
which the invariant measure is a sum of finitely many geometric terms. Similar 
to the evaluation of the random walks of which the invariant measures are 
of product-form, the performance measures of such systems can be readily 
evaluated. For any given random walk, we provide an algorithm to detect 
whether its invariant measure is a sum of geometric terms. Moreover, we also 
explain how to obtain this closed-form invariant measure explicitly, if it exists. 

When a closed-form invariant measure for a random walk in the quarter- 
plane does not exist, we usually have to find approximations for the perfor¬ 
mance measures we are interested in. Van Dijk et al. [^ [T0l[TT| developed a 
perturbation theory to approximate the performance of a queueing system by 
relating it to the performance of a perturbed queueing system of which the 
stationary distribution is of product-form. The method of van Dijk et al. relies 
on carefully constructing the modifications that provide the perturbed random 
walk. Goseling et al. [7] expressed the upper or lower bound of a performance 
measure as the value of the objective function of the optimal solution of a lin¬ 
ear program. This method generalizes the model modification approach based 
on the perturbed random walk developed in nnumis] and it accepts any ran¬ 
dom walk in the quarter-plane as an input. However, the random walk that 
is used as the perturbed random walk in the approximation scheme of |7] is 
still restricted to have an invariant measure that is of product-form, as we 
will see from some examples that in this paper, large perturbation might be 
required to obtain a product-form invariant measure. This prevents us from 
having good approximations for some random walks in the quarter-plane. Our 
second contribution is to establish an approximation scheme similar to that 
in 1^, where the perturbed random walk is allowed to have a sum of geo¬ 
metric terms invariant measure. With this extension, the approximations for 
performance measures will be improved because we have a larger candidate 
set for the perturbed random walks. Numerical results also illustrate that bet¬ 
ter approximations are achieved if we consider a richer candidate set for the 
perturbed random walks. 

The remainder of this paper proceeds as follows. In Section we present 
the model and definitions. In Section we provide an algorithm that checks 
whether the invariant measure of a given random walk is a sum of geomet¬ 
ric terms. In Section ^ we provide an approximation scheme to bound the 
performance measures when the invariant measure of the given random walk 
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Fig. 1 Random walk in the quarter-plane. 


cannot be a sum of geometric terms. We consider several examples and show 
numerical results in Section In Section we summarize our results and 
shortly discuss extensions of our approximation scheme. 


2 Model and problem statement 

We consider a two-dimensional random walk R on the pairs of non-negative 
integers, i.e., S = € No}. We refer to {{i,j)\i > 0, j > 0}, {{i,j)\i > 

Ojj = 0}i {(bj)l* = OjJ > 0} (0,0) as the interior, the horizontal axis, 

the vertical axis and the origin of the state space, respectively. The transi¬ 
tion probability from state (i,j) to state {i -I- s, j -I- t) is denoted by Ps,t{hj)- 
Transitions are restricted to the adjoined points (horizontally, vertically and 
diagonally), he., Ps,t{k,l) = 0 if |s| > 1 or |<| > 1. The random walk is homo¬ 
geneous in the sense that for each pair {i,j), {k,l) in the interior (respectively 
on the horizontal axis and on the vertical axis) of the state space 

Ps,t{iJ) = Ps,t{k,l) and ps^tii - s, j - t) = ps,t{k - s,l - t), (1) 

for all —1 < s < 1 and —1 < t < 1. We introduce, for i > 0, } > 0, the notation 
Ps,S,3) = Ps,t, Ps,o(i,0) = hs and Po,t(0, j) = Vt- Note that the first equality 
of 0 implies that the transition probabilities for each part of the state space 
are translation invariant. The second equality ensures that also the transition 
probabilities entering the same part of the state space are translation invariant. 
The above definitions imply that pi_o(0j 0) = hi and po,i(0j 0) = vi. The model 
and notations are illustrated in Figure [l] 
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All the random walks which we consider in this paper are assumed to be 
irreducible, aperiodic and positive recurrent. Moreover, we assume that at least 
one of the transition probabilities to North, Northeast or East is non-zero, i.e., 
Po,i +Pi,i +Po,i ^ 0- The reason is that the case po,i +Pi,i +Po,i — 0 which is 
necessary for applying the compensation approach has been discussed in detail 

in ID- 

Let m: S ^ [0,oo) denote the invariant probability measure of R, i.e., for 
i > 0 and j > 0, 

1 1 

ni(bi) = X! -*)Ps,t, (2) 

S = -l t^-1 

1 1 

m{i,0) = m{i — s,l)ps^-i + m{i — s,0)hs, (3) 

s=-l s=-l 

1 1 

t=-i t=-i 

We will refer to the above equations as the balance equations in the interior, the 
horizontal axis and the vertical axis of the state space. The balance equation 
at the origin is implied by the balance equations of all other states and is, 
therefore, not considered. 

Our interest is in the steady-state performance of R. The performance 
measures that we consider are induced by functions that are linear in each 
part of the state space, i.e., linear in the interior, on the horizontal axis and 
on the vertical axis. More formally, we consider the performance measure R, 
defined as 

jr= ^ m{i,j)F(i,j), (5) 

(bj)6S 

where F : S' —>■ [0, c») is defined as 

r,/i.o + /i.ib 

73,05 

I / 4,0 + /j.l* + 

and the fp^q are constants that define the function. 

If TO is a sum of geometric terms, then the performance measure F can 
be immediately obtained from (|^. In Section we will introduce such an 
invariant measure, i.e., a sum of geometric terms. In addition, we provide a 
complete characterization of the random walk of which the invariant measure 
is a sum of geometric terms. We also provide an algorithm to detect whether 
the invariant measure of a given random walk is a sum of geometric terms. 

For the random walk of which the invariant measure is not a sum of ge¬ 
ometric terms, we resort to deriving lower and upper bounds on J-. These 
bounds are constructed in Section ^ Measures that are a sum of geometric 
terms, defined next in Section form the basis for these bounds. 


if i > 0 and j = 0, 
if i = 0 and j > 0, 
if * = j = 0, 

1^2 j, if i > 0 and j > 0, 


( 6 ) 
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3 Random walks with an invariant measure that is a sum of 
geometric terms 

In this section, we will see that not all linear combination of geometric terms 
may yield an invariant measure of a random walk. We first characterize the 
linear combination of geometric terms that can be the invariant measure of a 
random walk. Then, we provide an algorithm to check whether the invariant 
measure of the given random walk is a sum of geometric terms. We apply this 
algorithm to several random walks. Finally, we show that the running time for 
the algorithm is finite. We also explain how to obtain the invariant measure 
explicitly, if it is a sum of geometric terms. 


3.1 Preliminaries 


We are interested in measures that can be expressed as a linear combination 
of geometric measures. We first introduce the following geometric measure. 

Definition 1 (Geometric measure) The measure is a geometric 

measure if m{i,j) = for some {p,(t) S (0,1)^. 

We represent a geometric measure p^a^ by its coordinate {p, a) in [0,1)^. Then 
r C [0, oo)^ characterizes a set of geometric measures. To identify the geomet¬ 
ric measures that satisfy the balance equations in the interior, on the horizontal 
axis and on the vertical axis of the state space, we introduce the polynomials 


Q{x,y) = xy 
H{x,y) = xy 
V{x,y) = xy 




(7) 

( 8 ) 
(9) 


respectively. For example, Q{p,a) = 0, H{p,a) = 0 and V{p,<7) = 0 imply 
that m{i,j) = p‘(J^, {i,j) G S satisfies (i), (§ and 0. respectively. If all 
balance equations are satisfied, then m{i,j) is the invariant measure of the 
random walk R. Let the curves Q, H and V denote the sets of (x, y) restricted 
to [0,oo)^, satisfying Q{x,y) = 0, H{x,y) = 0 and V{x,y) — 0. 

Next, we analyze the measures that are sums of geometric measures. 


Definition 2 (Induced measure) The measure m is called induced by T C 
(0, oo)^ if 

w(«,j)= H 

(p.o')Gr 

with a{p, a) G R\{0} for all (p, cr) G F. 
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We have excluded in Definitions and the case where p = 0 or u = 0, 
i.e., the case of degenerate geometric measures. The reason is that it has 
been shown in |3] that linear combinations that contain degenerate geometric 
measures cannot be the invariant measure for any random walk. 

Since we have assumed that pi^ +pi,i +Po,i ^ 0, we know from ElE] that 
in this case, ITI < oo, i.e., there are finitely many geometric terms in the set 

r, if 

(p,o-)Gr 

is the invariant measure of the random walk. 


3.2 Characterization 

We first provide conditions which the set F must satisfy such that the induced 
measure of F may be the invariant measure of a random walk. This result 
provides the theoretical support for the Detection Algorithm that will be pre¬ 
sented in the next subsection. The Detection Algorithm determines whether 
the invariant measure of a given random walk is a sum of geometric terms. 

The results in this and subsequent sections are based on the notion of 
uncoupled partitions of F and pairwise-coupled set, which were first introduced 
in E]. 

Definition 3 (Uncoupled partition) A partition {Ti, / 2 , • • • } of T is hor¬ 
izontally uncoupled if (p, cr) S Fp and (p, tf) S Fq for p ^ q, implies that p ^ p, 
vertically uncoupled if (p, a) S Fp and (p, a) G Fq for p ^ q, implies a ^ a, 
and uncoupled if it is both horizontally and vertically uncoupled. 

We call a partition with the largest number of sets a maximal partition. It 
has been shown in |3] that the maximal horizontally uncoupled partition, the 
maximal vertically uncoupled partition and the maximal uncoupled partition 
are unique. 

Definition 4 (Pairwise-coupled set) A set F is pairwise-coupled if and 
only if the maximal uncoupled partition of F contains only one set. 

Let Flset and 14et be the intersections of Q with FI and V, which are 
restricted to the unit square, i.e., 

Hset = {ix,y)G{0,lf\{x,y)GQnH}, (10) 

Vset = {{x,y) e (0, l)^|(a;,j/) GQnV}. (11) 

We first present the following lemma. 

Lemma 1 We have \Hset \ < 3 and |14et| < 3. 
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Proof Without loss of generality, we only consider the intersections of Q and 

H. It can be readily verified that the horizontal coordinates of the intersections 

of Q with H are the solutions of a polynomial of degree 4 equating 0 by com- 

\ ^ 1 

bining Equations ([^ and ([^ . Moreover, it is easy to verify that (1, ) 

is an intersection of Q and H. 

We are now ready to present the next theorem, the proof of which is given 
in Appendix]^ The theorem and its proof are built on the results from fm\ . 
The theorem characterizes the sets P for which the measure induced by P may 
be the invariant measure of a random walk. The result states that P must be 
a pairwise-coupled set connecting two geometric terms from set PI set U Vset ■ If 
both geometric terms are from PI set or both of them are from Vset, then the 
pairwise-coupled set contains an even number of geometric terms. If one of the 
geometric terms is from PI set and the other is from Vset, then the pairwise- 
coupled set contains an odd number of geometric terms. 

We exclude the case where |T| = 1 here, he., we do not consider the 
product-form invariant measures, because the characterization of this case has 
already been extensively studied. 

Theorem 1 If the invariant measure of the random walk R is induced by a 
set P, where 1 < |T| < oo, then P is pairwise-coupled and there exist unique 
{pi,ai),[p 2 ,(J 2 ) S P where {pi,ai) fy (^ 2 , 0 - 2 ) such that 

1- (Pl) <7i), (p2) 0'2) S ihset U fyfet- 

2. For fc = 1,2, if {pk,o'k) € Hset, then there exist a {p,a) € P\(pk,o'k) such 
that a = ak and there does not exist a (p, a) £ P\{pk, (Xk) such that p = pk- 
Similarly, if {pk,'Xk) £ Vset, then there exists a (p,cr) £ P\{pk,(Xk) such 
that p = Pk and there does not exist a (p, cr) £ P\{pk, (Xk) such that a = ak- 

3. If (pi,(Ti) £ Hset o-nd {p 2 ,<X 2 ) £ Vset, then |T| = 2fc -I- 1, where k = 
1,2,3, • • • . Otherwise, we have iTj = 2k, where fc = 1, 2,3, • • •. 


3.3 The Detection Algorithm 

We next introduce an algorithm which checks whether the invariant measure 
of a given random walk is a sum of geometric terms. We call this algorithm the 
Detection Algorithm. The Detection Algorithm is based on the construction of 
several pairwise-coupled sets. In particular, we construct one such set for each 
of the elements in Hset U Vset- If such a pairwise-coupled set contains another 
geometric term from Hset U Vset before it goes outside of the unit square, then 
the invariant measure of the random walk may be a sum of geometric terms. 
Next, the algorithm checks whether the geometric terms from the pairwise- 
coupled set are coupled in a correct manner, if Condition 2 in Theorem is 
satisfied. Notice that because of Theorem if such a pairwise-coupled set 
exists, then it must be unique. 


The Detection Algorithm: Check whether the invariant measure of a ran¬ 
dom walk i? is a sum of geometric terms. 
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Input: The random walk R\ Ps,t, hg, Vt for S {—1,0,1}. 

Step 1: Compute i?set and I4et- 

Step 2: Let (pi,ai) G Hget- We construct a set r(^ as follows: we have 
P 2 k ^ P 2 k- 1 , (^ 2 k = 0 ' 2 fc-l and P 2 fc +1 = P 2 k, <72k+l 0 ' 2 fc for k = 1,2,3, •••. 

We continue this procedure until we have {pn,o'n) G (0,1)^ and (pn+i, cr„+i) ^ 
(0,1)^. We denote this pairwise-coupled set with n elements by where 
= {(pi, (Ti), (p 2 , o' 2 ), • • • , (p„, cr„)}. We repeat this procedure for other ele¬ 
ments from FI set- The resulting pairwise-coupled sets are denoted by F^ where 
a < 3 and denotes the index of the element in Ilset- 

Step 3 : Let (pi,cri) G Vset- We construct a set F^ as follows: we have 
P 2 k = P 2 k-i, (^ 2 k ^ (^ 2 k-i and p 2 fc+i P 2 k, cr 2 k+i = o' 2 fc for k = 1,2,3, •••• 
We continue this procedure until we have (p„, (j„) C (0,1)^ and (p„+i, <Jn+i) ^ 
(0,1)^. We denote this pairwise-coupled set with n elements by F^ where 
F^ = {(pi, CTi), (p 2 , (J 2 ), • • • , (pn, cr„)}. We repeat this procedure for other ele¬ 
ments from Vset- The resulting pairwise-coupled sets are denoted by F^ where 
b < 3 and denotes the index of the element in Vset- 

Step 4: Check whether the geometric terms from the pairwise-coupled set are 
coupled in a correct manner. 

1. Consider F^. If there exists k^ G Ng such that the element (p 2 koj ^ 2 ko) G 
-ffset, then the invariant measure of i? is a sum of geometric terms. More¬ 
over, the invariant measure is induced by the set {(pi, cri),..., (p 2 ko> f^ 2 kQ)} C 
F^. We repeat this procedure for all F^ where a < 3. 

2. Consider F^ . If there exists kg G No such that the element (p 2 fc(,+i, cr 2 feo+i) G 
Vset-, then the invariant measure of i? is a sum of geometric terms. Moreover, 
the invariant measure is induced by {(pi, cti), ..., (p 2 fco+i, cr 2 fco-i-i)} C 

We repeat this procedure for all F^ where a <3. 

3. Consider FY- If there exists kg G No such that the element {p 2 ko,^ 2 ko) G 

Vset-, then the invariant measure of i? is a sum of geometric terms. Moreover, 
the invariant measure is induced by {(pi, CTi), ..., (p2fcoi'^2feo)} ■ We 

repeat this procedure for all F^ where b <3. 

4. Consider FY - If there exists kg G No such that the element (p2feo+i, cr2fco+i) ^ 
Flset, then the invariant measure of i? is a sum of geometric terms. More¬ 
over, the invariant measure is induced by {(pi, cti), ..., (p 2 fco+i, cF 2 ko+i)} C 
FY - We repeat this procedure for all FY where b <3. 

Step 5 : If none of the conditions in Step 4 holds, then the invariant measure 
of R is not a sum of geometric terms. 


We now apply the Detection Algorithm to two examples. 

Example 1 We have pi^ = 0.05, p- 1,1 = 0.15, po,-i = 0.15, po.o = 0.65, 
hi — 0.15, hg = 0.7, Vi = 0.0929, V-i = 0.15, Vg = 0.7071. The other transition 
probabilities are zero. 

We see from Figure that there exists a pairwise-coupled set with 3 geo¬ 
metric terms satisfying the criterion in the Detection Algorithm. Hence, the 
invariant measure of Example is a sum of 3 geometric terms. 
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Fig. 2 App ly th e D etect ion Algorithm to Example 


the squares, (a) . (b) 


rY- 


0 


The geometric terms are denoted by 




Fig. 3 App ly th e D etect ion Algorithm to Example]^ 
the squares, (a) . (b) FY ■ 


The geometric terms are denoted by 


Example 2 We have pi^ = 0.05, po,i = 0.05, P-ip = 0.2, p-ip = 0.2, po.-i = 
0.2, pi,_i = 0.2, po,o = 0.1, hi = 0.5, /i_i = 0.1, ho = 0.15, vi = 0.1, 
V-i = 0.06, Uq = 0.59. The other transition probabilities are zero. 


In Figures 3(a) and 3(b) 


we construct the pairwise-coupled sets, E^ and 
EY, starting from the elements in Hget = {{Ph.crh)} and Vset = {{pv.'Jv)}, 
respectively, until they go outside of the unit square. Notice that E^ H {Hget U 
Vset\{ph,<Jh)) = 0 and EY n {Hset U Vset\{pv, ctv)) = 0- Hence, the invariant 
measure of Example cannot be a sum of geometric terms. 
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3.4 Running time of the Detection Algorithm 

In this section, we show that the Detection Algorithm has a finite running 
time. More precisely, we provide an upper bound on the number of terms in 
the pairwise-coupled sets that are constructed in Steps 1 and 2 of the Detection 
Algorithm. In particular, we show that this construction provides a geometric 
term outside the unit square in a finite number of steps. 

We first introduce the notion of branch points of Q. A point (xo,yo) G Q 
that satisfies Ay(xo) = 0, where 

Ay(x) = ^ X! - X 


-4 


E 

\s—-l 


X -1 





S = -l 


( 12 ) 


is called a horizontal branch point of Q. Since the algebraic curve Q has a 
unique connected component in [0, oo)^ (see Lemma 7, [5]), it has two hori¬ 
zontal branch points in [0,oo)^, denoted by (xb^yt), {xt,yt) with yt > yt- In 
Appendix we provide more details on the branch points of Q as well as a 
proof of the next result. 


Theorem 2 Consider a random walk R. For any pairwise-coupled set F G Q, 


if |T| > M{R) with M[R) = 


,1)2) 


+ 4, = 


_ Cb) 

EL-iP.,-1 


Do = 


^ then there exists a ip,a) € F such that p > \ or a > \. 

Moreover, when pip -|-pi,i -l-po,i 0) we have Di > 0 and D 2 > 0. Flence, 
M{R) < 00 . 


Theorem [^guarantees that the Detection Algorithm stops in finite time, since 
the pairwise-coupled set will go outside of the unit square with a bounded 
number of steps. 


3.5 Construction of the invariant measure 

If a random walk has an invariant measure that is a sum of geometric terms, 
then the Detection Algorithm will provide the set F that induces this measure. 
It remains to construct the weighting coefficients in the linear combination of 
geometric terms. We next explain how to find the coefficients in the induced 
measure if the invariant measure of the random walk is a sum of geometric 
terms. 

We will use Lemma 6 from [Jj to determine the coefficients in the induced 
measure. We find it convenient to repeat it here. 

Lemma 2 Consider the random walk R and a measure m induced by F. Then 
m is the invariant measure of R if and only if B^ip, a) = 0 and B^ip,a) = 0 
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for all {p, a) G F, where 




Oi{p,a) 


■ 1 

{p^~"hs+p^~‘aps-i) - p , 

s=-l 


(13) 


B''{p,a)= Y Oi{p,a) 

{p,(T)^r 1(7—a 


■ 1 

Y +pa^~*p-i,t) - cr 

.t = -l 


(14) 


Lemma states that every two coefficients of the geometric terms with the 
same horizontal or vertical coordinates must satisfy a linear relationship. 

The construction of the coefficients is as follows. We first fix the weighting 
coefficient for one of the terms in F to an arbitrary value. Since this term is 
coupled to other terms in F, we can now compute the weighting coefficient 
for these terms using Lemma Following the same reasoning, we obtain val¬ 
ues for all coefficients. Finally, we rescale all coefficients in order to ensure 
md i) - 1 

Z^i=o 

We provide an example for the case that 


B = {(pi, CTi), (P2, 0 - 2 ), (p3, era), • ■ ■ 


where pi ^ P 2 , cti = 0 - 2 , P 2 = Ps, <^2 0 - 3 , -We first fix a(pi, cri) = 1. Next, 

we compute a{pk, Uk) consecutively, for fc = 2,3,4,.... The value of the even 
terms a{p 2 e, o' 2 e), where £=1,2,3,... is given by: 

_ 2 ^ 

Ot{p 2 t.,^ 2 l) =-777-a(P2f-l W2^-l), 

IV 2£ 

where 


1 ^ / 

Wk = {I — )vi -I- (1 - (Jk)v-i -I- Y p^,t - jOfc I 

\ ,_ 1 


<^k v-l.t 


t=-l 


\t=~l 


The value of the odd terms a{p 2 i+i, 0 - 21 + 1 ), where £=1,2,3,... is given by: 


Oi{p 2 i+l, 0 - 2 i+l) 


a{p 2 t, <J 2 t), 

-L 2 t+l 


where 


Tk = {l 


— )hi -|- (1 — pk)h-i ~\- 

Pk 


1 


^ ^ Ps,! O-k 
s=-l 



Finally, all coefficients are rescaled to obtain a probability measure. 
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4 Approximation analysis 

In this section, we provide an approximation scheme to establish upper and 
lower bounds for performance measures of a random walk for which the invari¬ 
ant measure is unknown. This scheme is similar to that developed in [7] in the 
sense that a linear program is developed to approximate the performance mea¬ 
sures. We will give an overview of this approach below. The main difference 
in the current work is that we enlarge the candidate set of perturbed random 
walks that can be used in the approximation scheme. In particular, our approx¬ 
imation is based on a perturbed random walk of which the invariant measure 
is a sum of geometric terms. In addition to presenting the scheme itself in 
Section |4.1[ we show how such a perturbed random walk can be constructed 
in Section l4^ 


4.1 Approximation scheme 


Recall from Section that our approximation analysis provides, for a given 
performance measure, upper and lower bounds for J- = m{i, j)F(i, j). 

Moreover, we consider the case that m is unknown. In particular, m is not 
a sum of geometric terms. The upper and lower bound on F that our ap¬ 
proximation provide are expressed in terms of the invariant measure fh : 
S —> [0, oo) of another random walk R, which we will refer to as the per¬ 
turbed random walk. The perturbed random walk that we will consider has 
771 = a)^r <j)p‘a^ for some F. The transition probabilities of R are de¬ 
noted by ps^t for s, t S {—1,0,1}. Moreover, we use gs,t where s, t G {—1, 0,1} 
to denote the difference between the transition prob abili ties in R and the 
corresponding transition probabilities in R. In Section 


4.2 


we provide a con¬ 
struction of R. In the remainder of this section we present our approximation 
scheme based on the assumption that R is already known. 

We interpret F as a reward function, where F*{i,j) is the one step reward 
if the random walk is in state We denote by F*{i,j) the expected cumu¬ 

lative reward at time t if the random walk starts from state (i,j) at time 0, 
i.e., 


H* + w,J+w), ift>0. 

The next result from [21 provides bounds on the approximation errors for 

F. 

Theorem 3 (JSj) Let F : S ^ [0, oo) and G : S ^ [0,oo) satisfy 
\Fihj)-Fihj)+ X! <lu,viF*ii + uJ+ v)-F\i,j))\ <G{i,j), (15) 

u,vG{ —1,0,1} 
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for all {i,j) S S and t > 0. Then, 


Based on Theorem we develop a linear program similar to that in [7] to 
approximate J-. This linear program provides a set of sufficient constraints 


for (15 \ and an objective function that optimizes the upper (or lower) bound 
on J-. In the linear program, we consider F and G as variables and qu,v, F* and 
rh as parameters. In |7], the invariant measure of the perturbed random walk 
is only allowed to be of product-form. The difference with the current work 
is that in our approximation scheme the invariant measure of the perturbed 
random walk can also be a sum of geometric terms. This difference will only 
affect the objective function of the linear program. 

The constraints developed in |7] are obtained from Theorem Without 
additional precautions the number of constraints that is obtained is not fi¬ 
nite because the state space S contains infinitely many states and the time 
horizon is also infinite. In order to have a finite linear program with finitely 
many constraints the variables and the parameters in the linear program are 
constrained to be component-wise linear functions, he., similar to how F{i,j) 
is defined in Section The rationale behind this is that non-negativity con¬ 
straints on (linear combinations of) such functions can be expressed in a fi¬ 
nite number of constraints. As second step towards a finite linear program, 
F*(i + u, j + v) — F^{i,j) where u,v G {—1, 0,1} is uniformly bound over t. In 
this manner finitely many constraints in finitely many variables are obtained. 
We refer the reader to [7] for details. For the remainder of this paper we capture 
the required results from [7] in the following theorem which captures sufficient 
conditions for (151 in terms of a polytope V. 


Theorem 4 ([7j) Let F and G be component-wise linear functions. If {F, G) G 
V then 


51 [Piij)-G{i,j)]m{i,j) < F < [F{i,j) + G{i,j)]m{i,j). 




(ij)es 


Moreover, V can be represented with a finite number of constraints that are 
linear in the coefficients that define F and G. 

The difference with |7] is that instead of only using a perturbed random 
walk of which the invariant measure is of product-form, we are also allowed 
to use a perturbed random walk of which the invariant measure is a sum 
of geometric terms as well. Hence, we are able to find the upper and lower 
bounds for T based on a richer set of perturbed random walks with closed- 
form invariant measures fh. The linear programs that provide F^p and Flow 
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Fig. 4 Perturbed random walk in the quarter-plane. 


are 


Fup = min 

^]o«, = max<| Y [F{iG) - G{i,j)\fh{i,j) 


(f,g)gp|, 

{F,G)&v\. 


Notice that the measure m is a parameter in the above linear programs. The 
transition rates in R, moreover, affect the constraints in V. We will demon¬ 
strate in Section that the choice of R and m can significantly affect the 
bounds Fup and Flow ■ The best upper and lower bounds might be achieved by 
using different perturbed random walks. In the next section, we explain how 
to find such a perturbed random walk R. 


4.2 Perturbed random walk R 

In this section, we first show how to find a perturbed random walk R such 
that the invariant measure of .R is of a given product-form, he., fh(i,j) = 
p^aF Then, we show how to find the perturbed random walk R of which the 
invariant measure is a sum of geometric terms. We restrict our attention to 
the case where for the perturbed random walk R, only the transitions along 
the boundaries of the state space S, which are denoted by hi,h-i,hQ and 
hi, u_i, ho, are different from that in the original random walk R, see Figure]^ 
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The construction of hi,h-i,hQ and vi,v-i,vo will take place in three 
phases. Before providing details we provide an overview of all phases. In the 
first phase we will let = vq = 0 and find non-negative values of hi, h_i, vi, 
V-i that ensure that all balance equations are satisfied. We allow these values 
to be larger than one and we do not require that outgoing transitions sum to 
one. In the second phase we scale the values of all transitions probabilities in 
R and the values of hi, /i_i, vi, V-i such that the resulting values are properly 
normalized transition probabilities. In the third phase we scale the transition 
probabilities of R with the same constant. 

Next, we define the scaling operation more precisely in terms of the notion 
of a C-rescaled random walk. Since the values of hi, /i_i, vi, V-i that are 
obtained in phase 1 are not necessarily transition probabilities we denote them 
by Hi, H-i, Vi, V-i to avoid possible confusion. The resulting system might 
not be a random walk and will be denoted by TZ. 

Definition 5 (C-rescaled random walk) Consider TZ with ps^t where 
s,t G {—1,0,1} in the interior and Hi, H-i, Vi, V-i for the boundaries. 
Let C > 1. The random walk R is called the C-rescaled random walk of 
TZ if the transition probabilities of R are Ps,t = for (s,t) (0,0) and 

Po,o = t)yt(o 0 ) Ps,t- Moreover, the boundary transition probabilities are 

hi = h_i = ho = 1 - hi - h_i - Yll=-iPs,i, vi = h-i = ^ 
and uo = 1 - hi - u-i - SL-iPi.*- 

Clearly, if fh{i,j) = p’’a^ satisfies all balance equations for all states in TZ, then 
fh{i, j) satisfies all balance equations for all states in a C-rescaled random walk 
of TZ as well. Therefore, scaling the original random walk R with the same 
constant C, will not affect its invariant measure. Moreover, we can now apply 
the approximation scheme from the previous section by comparing the two 
rescaled random walks, since they will have the same transition probabilities 
in the interior of the state space. 

If the given measure is of product-form, then we find the new boundary 
probabilities in the perturbed random walk such that the algebraic curve H 
and V will cross this point which leads to the product-form invariant measure. 
If the given measure is a sum of an odd number of geometric terms which 
form a pairwise-coupled set, then we find the new boundary probabilities in 
the perturbed random walk such that the algebraic curves H and V will cross 
two specific points from this pairwise-coupled set. 


4-.2.1 R with a product-form invariant measure 

The first step is to construct the scalars Hi,H-i and Vi,V-i which can be 
greater than 1. Notice that, if fh{i,j) = pV-’ satisfies the balance equations for 
all states from S, the scalars Hi,H-i and Vi,V-i must satisfy the horizontal 
and vertical balance equations in ^ and respectively. Inserting m{i,j) = 
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into equation ^ gives 


P Vps _1 - ^ Ps,l. 
s=-l s=-l 


(16) 


Equation (161 is linear in the two unknowns Hi, H-i. The non-negative Hi, H-i 


exist because the slope of equation (16) is positive. Similarly, non-negative Vi 
and V-i can also be found. 

The next step is to start rescaling. Therefore, we determine Ch and Cy as 
follows. 


1 1 
Ch = Hi + H_i -b ps i and Cy = Vi + V-i -f pi^f 

s=-l t=-l 

We take C = max{c/j, Cy}. 

If C < 1, then the random walk with hi = Hi, h-i = H-i, vi = Vi, V-i = 
E_i as boundary transition probabilities is the perturbed random walk R with 
invariant measure fh. 

If C > 1, we do not consider the original random walk R anymore. We 
consider the C-rescaled random walk of R, which is denoted by R, to be the 
input random walk for the approximation scheme. Moreover, the random walk 
R with hi = ^,h_i = ^^^,vi = ^,u_i = as boundary transition 
probabilities is the perturbed random walk of R, instead of R. 


4-2.2 R with a sum of geometric terms as invariant measure 

Similarly, we find the perturbed random walk R of which the invariant measure 
is m = J2{p a)er (j)p^cr^ where |r| = 2A: -b 1, with fc = 1, 2, 3,_ 

Using Theorem]^ we find {pi,ai) to be the geometric term from the set 
r which does not share the horizontal coordinate with any other geometric 
terms from set F. Similarly, we find (p 2 , o' 2 ) to be the geometric term from the 
set r which does not share the vertical coordinate with any other geometric 
terms from set F. 

Instead of looking for the scalars Hi, H_i, Vi and U_i which satisfy the 
horizontal and vertical balance equation for the product-form rh(i,j) = p^a^, 
we find Hi and iJ_i, which satisfy the horizontal balance for the geometric 
measure p\crl, and Vi and V-i, which satisfy the vertical balance for the 
geometric measure p^c^ (see Lemma [^. Again, we compute Ch and c„. If 
C < 1, we find R directly. If C > 1, we consider the C-rescaled random walk 
of R, R, as the input random walk for our approximation scheme. Moreover, 
we find the perturbed random R for R similar to the case when the invariant 
measure of R is of product-form. 
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5 Numerical illustrations 

In this section, we apply the Detection Algorithm and the approximation 
scheme developed in Section to several random walks. For any given ran¬ 
dom walk, we provide the explicit form of the invariant measure if it is a sum 
of geometric terms. Otherwise, we provide error bounds for the performance 
measures. 

We show that the bounds for the performance measures will be improved 
when using a perturbed random walk of which the invariant measures is a sum 
of geometric terms instead of a perturbed random walk of which the invariant 
measure is of product-form as in [7]. 

In particular, we are interested in following performance measures of a 
random walk in the quarter-plane, 

J-\\ the average number of jobs in the first dimension, 

J- 2 '- the probability that the system is empty. 

Notice that the function F(i^j) used to determine F is component-wise linear. 
It can the readily verified that the performance measure F is Fi if and only 
if we assign the following values to the coefficients: /iq = 1 and / 4 ^i = 1 and 
others 0. Similarly, the performance measure F is F 2 if and only if we assign 
the following values to the coefficients: = 1 and others 0 . 

We use [Fl]up/iow, [^ 2 ]up/iow to denote the upper and lower bounds for 
the performance measures obtained via a perturbed random walk of which 
the invariant measure is of product-form. We use [Fi\up/iowi [^ 2 ]up/iow to 
denote the upper and lower bounds for the performance measures obtained 
via a perturbed random walk of which the invariant measure is a sum of 3 
geometric terms. 

The next example we consider here has also been mentioned in (2]. 


Example 3 We have pi^o = 0.05, po,i = 0.05, p- 1,1 = 0.2, p-i.p = 0.2, po,-i = 
0.2, pi,_i = 0.2, po,o = 0.1 and hi = 0.5, h-i = 0.1, hg = 0.15, vi = 0.113, 
V-i = 0.06, vq = 0.577. The other transition probabilities are zero. 


In Figure 5(a)| all non-zero transition probabilities, except those for the tran¬ 
sitions from a state to itself, are illustrated. 


Using the Detection Algorithm, we find the invariant measure of this ran¬ 
dom walk is 


5 

='^akplcri, 

k^l 

where the geometric terms are the solid squares in Figure |5(b)| and the co¬ 
efficients are ai = 0.0088, 02 = 0.1180, 0:3 = —0.1557, 04 = 0.1718, as = 
—0.1414. Therefore, we are able to compute the performance measures directly 
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(b) 


Fig. 5 Example|3||(a)|Transition diagram. 


(b) 


Algebraic curves Q, H and V. The geometric 


terms contributed to the invariant measure are denoted by the squares. 


from m(z, j), 




^2 


5 oo oo 

I] akipWk 

k—1 2—0 j—0 
5 

= 0.0015. 


E 


fc=i 


Pk _ 

(1 - PkY l- <7k 


41.2062. 


Example 4 We have pip = 0.1, pop = 0.1, P-ip = 0.1, p-i,o = 0.3, po,-i = 
0.3, pi-i = 0.1 and hi = 0.1, h-i = 0.02, ho = 0.68, vi = 0.1, V-i = 0.03, 
Vo = 0.67. The other transition probabilities are zero. 
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Fig. 6 Example|4 
terms are denoted by the squares. 


(a) 


Transition diagram. 


(b) 


Algebraic curves Q, H and V. The geometric 


In Figure 6(a) all non-zero transition probabilities, except those for the tran¬ 
sitions from a state to itself, are illustrated. 

Using the Detection Algorithm, we conclude that the invariant measure 
cannot be a sum of geometric terms. Instead, we will find error bounds for 
Ti- We first obtain error bounds for using a perturbed random walk of 
which the invariant measure is of product-form. Figure 7(a) [ shows 12 different 
geometric terms which are the invariant measures of the perturbed random 
walks used to bound J-i. Moreover, we bound based on a perturbed random 
walk of which the invariant measure is the sum of the 3 geometric terms that 
are depicted as solid squares in Figure [6(b)[ Finally, we find error bounds for 
J-i in Figure 7(b) Figure 7(b) shows that the minimum of [J-l]up and the 
maximum of [J-i]iow, when perturbed random walks of which the invariant 
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(b) 


Fig. 7 


(a) 


The geometric measures from Q. 


(b) 


Error bounds for The a:-axis in 


(b) 


are the index of 12 geometric measures in |(a)| sorted from left up corner to the right down 


measures are of product-form are used, are 

min([J-i],p) = 5.4200, max([J-i = -1.9527. 

Note that lower bounds which provide negative values are not directly useful, 
since J- can always be lower bounded by 0. However, these bounds indicate the 
range of errors that our approximation scheme may lead to. The upper and 
lower bounds for when the perturbed random walk of which the invariant 
measure is a sum of 3 geometric terms which are depicted in Figure |6(b)| is 
used, are 

[T^Up = 2.9026, = 0.8964. 

Clearly, [J^i\up a,nd [J-i\iow outperform [J^l]up a,nd [J-l]iow From the results 
above, we conclude that using a perturbed random walk of which the invariant 
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measure is a sum of multiple geometric geometric terms improves the error 
bounds compared with only using the perturbed random walk of which the 
invariant measure is of product-form. 

In the next example, we consider a discrete-time Markov chain obtained 
by uniformizing a tandem queue model. The special feature of this model is 
that, when the first server is idle, the service rate in the second server will be 
slower. 


Example 5 (Tandem queue with server slow-down) Wehavepi^o = 0.1,p_iq = 
0.2, po,-i = 0.3, Pop = 0.4, hi = 0.1, ho = 0.7, V-i = 0.03 and vo = 0.87. The 
other transition probabilities are zero. 


In Figure 8(a) all non-zero transition probabilities, except those for the tran¬ 
sitions from a state to itself, are illustrated. 

Using the Detection Algorithm, we conclude that the invariant measure 
cannot be a sum of geometric terms. Instead, we find error bounds for J- 2 . We 
first obtain error bounds for 7^2 using a perturbed random walk of which the 
invariant measure is of product-form. Figure 9(a) [ shows 12 different geometric 
terms which are the invariant measures of the perturbed random walks used 
to bound J^ 2 - We also bound E 2 based on a perturbed random walk of which 
the invariant measure is the sum of 3 geometric terms which are depicted as 
solid squares in Figure [8(b)| Finally, Figureshows bounds for ^ 2 - 

We obtain the error bounds for T 2 in Figure]^ From Figure [9(b)[ we have 

min([J'2]up) = 0.5258, max([J^2];oii;) = —0.1070. 


Using the perturbed random walk of which the invariant measure is the sum 
of 3 geometric terms depicted as solid squares (see Figure [8(b)| ), we obtain the 
upper and lower bounds for ^ 2 '- 

[J-|]„p = 0.2367, = 0.1346, 


respectively. 

Clearly, [J'fjup and [Jllioiu outperform [El]up and [El]iow 

Note that there is no monotonicity between the number of geometric terms 
used in the invariant measure of the perturbed random walk and the error 
bounds of the approximated performance measure. For example, if we use 
the perturbed random walk of which the invariant measure is induced by 5 
geometric terms, the error bounds for the approximated performance measure 
is not necessarily better than that obtained via the perturbed random walk 
of which the invariant measure is induced by 3 geometric terms. This is the 
reason why we do not give many numerical illustrations when the invariant 
measure of the perturbed random walk is induced by E where lUl = 5, 7,9,.... 

Finally, note that in out numerical illustrations, perturbations to invariant 
measures with 3 geometric terms are better than perturbations to product- 
form invariant measures. However, there are also examples when perturbations 
to product-form invariant measures provide the best results. 
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Fig. 8 Example^ 
terms are denoted 


(a) 


Transition diagram. 


>y the squares. 


(b) Algebraic curves Q, H and V. The geometric 


6 Conclusion and discussion 

In this paper, we developed an algorithm to check whether the invariant mea¬ 
sure of a given random walk in the quarter-plane is a sum of geometric terms. 
We also showed how to find the invariant measure explicitly, if the answer 
is positive. Random walks with such performance measures can be readily 
evaluated. For the case that the invariant measure of a given random walk 
is not a sum of geometric terms, we developed an approximation scheme to 
determine the performance measures. These bounds are determined using a 
perturbed random walk which differs from the original random walk only in 
the transitions along the boundaries. We showed numerically that considering 
a perturbed random walk of which the invariant measure is a sum of geometric 
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(a) 



(b) 


Fig. 9 
the 12 


(a) 


The geometric measures from Q. 


(b) 


Error bounds for T 2 • The x-axis in 


geometric terms in|(a)|sorted from left up corner to the right down corner. 


(b) 


terms instead of a perturbed random walk of which the invariant measure is 
of product-form results in tighter bounds for the performance measures. 

In this paper, we assume pi^ -l-po,i 0 because when pi^ + pi^i + 

Po,i = 0) the algebraic curve Q of the random walk has an accumulation point 
at the origin. In this case, the Detection Algorithm may not stop in finite 
time. However, this does not prevent us from using the approximation scheme 
developed in Section [4. 1| to obtain bounds on the performance measures, i. e., 
using a perturbed random walk of which the invariant measure is a sum of 
finitely many geometric terms. Therefore, we conclude that our approximation 
scheme accepts any random walk as an input. 
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A Proof of Theorem [T] 

In order to prove Theorem^ we first present a lemma. The vertical branch points which will 
be used here are defined similarly to the horizontal branch points before. Since the algebraic 
curve Q has a unique connected component in [0, oo)^ (see Lemma 7, [2]), it has two vertical 
branch points in [0,co)^, denoted by {xi,yi), {xr^yr) with xi > Xr- 

Lemma 3 Consider the measure m induced by set F, which is the invariant measure of 
random walk R. If we connect every two geometric terms with the same horizontal or vertical 
coordinates from set F with a line segment, then these line segments cannot form a cycle. 

In order to prove Lemma[^ we define two types of partition of Q, see Figure [To] 

Definition 6 (Partition I of Q) The partition {Qqo^Qqi^Qio^Qh} of Q is defined as 
follows: Qoo is the part of Q connecting (xi , yi) and (xb^yb)', Qio is the part of Q connecting 
i^b^Vb) {^r,yr)\ Qoi is the part of Q connecting {xi,yi) and [xt,yt)\ Qii is the part of 
Q connecting {xr,yr) ^-nd (xt,yt)‘ 

Definition 7 (Partition II of Q) Let {Qi,Qc,Qr} denote a partition of Q, where 

Qi = {{=^,y) e Q I * < x;,}, 

Qc = {{x,y) e Q \ xi, < X < xt} , 

Qr = {{x,y) e Q \ X > Xt} ■ 


Proof (Proof of Lemma Denote the two pieces of Qc in Figure 10(b) by Q(. and 

satisfying y > y if (x,y) S Q(. and {x,y) S Q^. Since the algebraic curve Q contains no 
singularity, because of Theorem 12 from [2], Qi,Qc and Qr are all non-empty. 

In addition, we let {Fi,... ,Fjy} denote a partition of F, where the elements of Ft are 
denoted by F; = , Cij),..., each Ft satisfies 


Pi,i > Pi,2, 
Pi,2 = Pi,3, 
pi,3 > Pi,i, 


Ci,! — Ui,2, 
a'i,2 rTj 3, 
^i,3 — 


(17) 


Pi,L(i)-l > Pi,L(i) 


^i,L(i)-l - o-i,L(i)- 
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In addition the partition {Fi,..., Fk} is maximal in the sense that no Fi U Fj, i ^ j 
satisfies 0- 

Assume that the line segments, which connect every two geometric terms with the same 
horizontal or vertical coordinates from set F, form a cycle. Without loss of generality, we 
will have Fi, F 2 where \Fi\ > 1 and I/ 2 I > 1 such that pij = p 2 ,i and pi,i,p 2 ,i € Qr- 
Moreover, either pi^i or p 2 ,i must be on Q\\. However, yt > 1 and Xr > 1, by [5| Lemma 
2.3.8]. Also, using the fact that Qn is monotonic, by Lemma 9 from [2], we conclude that 
Qii is outside of U, which contradicts that m is a finite measure. 

We are now ready to prove Theorem^ 

Proof (Proof of T/ieoremQjj First, it follows from Theorem 4, [3] that F must be a pairwise- 
coupled set. 

From Lemma the pairwise-coupled set F cannot form a cycle. Hence, there must be 
two geometric terms which do not share the horizontal or vertical coordinate with other 
geometric terms from set F. We denote these two geometric terms by (pi, cri), (p 2 , 0 - 2 ). 

It follows from Lemma[^that the measure induced by any two geometric terms from set 
F, which have the same horizontal coordinates, must satisfy the horizontal balance equation. 

Without loss of generality, we assume that (pi, cri), (p 2 , cr 2 ) E Hset- Thus, for /c = 1,2, 
we have 


B'*(pfc,o-fe)= (pj. ‘'hs + pl '*(TfcPs,-l) - Pfc = 0. (18) 

s = —1 

Hence, for k = 1,2, there exists no (p, cr) E F\{pk, a^) such that p = p^. Otherwise, 
the balance for (pfejcr^) and (p, cr) cannot be satisfied. Moreover, because F is a pairwise- 
couple set, there exist a (p, cr) E F\(pk, a^^;) such that a = Similar results hold when 
(pi, CTi), (p 2 , (T 2 ) E Vset or when (pi,o-i) E Hset and (p 2 ,cr 2 ) E Vset- 

It can be readily verified that if (pi,cri) £ Hset and (p 2 ,o' 2 ) ^ Vset, then |F| = 2fc -|- 1, 
where fc = 1, 2, 3, • • •. Otherwise, we have |F| = 2k where k = 1, 2, 3, • • • . 

Finally, if such pairs (pi, cri), (p 2 , 0 - 2 ) are not unique, then, by carefully choosing the 
coefficients, we find 2 signed measures to make all balance equations satisfied. However, this 
contradicts the uniqueness of the invariant measure, which completes the proof. 


B Proof of Theorem 


Proof (Proof of Theorem\^ Similar to the proof of Lemmaj^ we find {Fi ,..., F^} which 
are defined in 0- 

First, we prove L{i) < 00 by demonstrating that 

< 1, \FinQe\ < 00 , \FinQr\ < 1. 


Suppose that {FiOQrl > 2. Then there exist (p, cr) and (p, d-) on Qn or Qio satisfying 
a = cr. This contradicts Lemma 9, [2, which indicates the monotonicity of Qn and Qio- 
Therefore, \Fi fl Qr \ < 1- Similarly, we show \Fi fl < 1. 

Next, we prove that crij ^2 ^ — min(Di,Z) 2 ) where 


Di = 


Ay{Xb) 


X]3=-l 


,D2 = 


Ay{Xt) 


5I]s = -l 


for three consecutive elements in n Qd, (pi,j, (Pi+i,j+ii o-i+l,i+l) and {pi+ 2 ,j+ 2 ,(^i+ 2 , 
satisfying 

Pi,j ^ + 

Pi,j + 1 ~ Pi,j+2, ^ ^2,2+2* 

Note that 2\y(x) > 0 and Ay{x) has at most one stationary point where the derivative is 0 
for X E {xb,xt) because 2\y(x) is continuous over x and Ay(x) = 0 has 4 real solutions due 





Invariant measures and error bounds for random walks in the quarter-plane 


27 


to Lemma 4, [2]. We obtain that Ay(x) > min(Z\y(a:;,), Ay{xt)). Moreover, it can be readily 
verified that — is monotonically increasing in x for x E (xb^xt). Therefore, 

we have 


Av(x) 




> min 


^ i^b) 

X]s--1 Ps,-l^t -1 Ps,- 


14 " 


(19) 


for X E (xfo, xt). 

Notice that the left side of equation ( |19[ | is the distance between two intersections of Q 

and a vertical line, i.e., =n-—— jg the distance between two intersections of Q and 

line X = a. Therefore, we conclude that aij^2 ^ ^i,j — min(Z)i, D 2 ) where 


Di = 


Ay(Xb) 


X!s =-1 Ps,-l^t 


,D2 = 


Ay{Xt) 


Es^-1 


Next, we show that if A" > 2, then there exists a (p, cr) E F such that p > 1 or 
cr > 1. Without loss of generality, we assume K = 3. Observe that {Fi, r 2 ^ P^} forms a 
pairwise-coupled set. Using from the above that \Fi\ < 00 for i = 1,2,3, we must have 
Pl,L(i) = P2,L(2) with Pi,L(i),p2,L(2) ^ Ql P2,l = P3,l with p2,i,p3,l £ Qr after a 
proper ordering of {Fi^ F 2 , Fs}- Moreover, either p 2 ,i or p 3 ,i must be on Qn. However, 
pi > 1 and Xr '> 1 due to (5] Lemma 2.3.8]. Also, using the fact that Qn is monotonic, due 
to Lemma 9 from [2], we conclude that Qn is outside of U. Hence, there exists a (p, a) £ F 
such that p > 1 or (T > 1. 

When K < 2, we know that the distance between two intersections of Q and a vertical 
line X = a where a E (xb,xt) is at least min(Di,D2)- 
Therefore, we conclude that if 


\F\ > M{R) 


6 

min(Di, D 2 ) 


+ 4, 


then there exists a (p, cr) E F such that p > 1 or cr > 1. We know from Theorem 12, [2], 
that the algebraic curve Q can only have an accumulation point at the origin when pi,o + 
Pi,i + Po,i = 0- Hence, when pi^o + Pi,i + P0,i 7^ we have Xb > 0 and xt > 0. This means 
that Di > 0 and D 2 > 0. Therefore, we have M{R) < 00 . 











